Method and Apparatus For Segmenting Media Content

ABSTRACT

To create information in media content a standardized segment tag associated with macro segments is created To extract segments from media content, macro segments of the contiguous stream are identified based on the presence of a standardized segment tag associated with each identified segment and data is extracted from each identified segment based on the associated tag. In a device for creating information in media content, a processor identifies macro segments of the contiguous stream and creates a standardized segment tag associated with each segment. A memory stores the macro segments and the standardized tag associated with each segment. A device for extracting segments includes a processor configured to identify macro segments of the contiguous stream based on the presence of a standardized segment tag associated with each segment. The processor extracts data from each identified macro segment based on the associated standardized tag. A memory stores the extracted data.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of co-pending U.S. application Ser.No. 13/166,505, filed Jun. 22, 2011, which is incorporated by referencein its entirety.

BACKGROUND

Set-top boxes with DVR capability have given the television viewergreater flexibility in the manner in which the viewer watches TVprograms. The viewer can record the broadcast program and watch it at alater point in time. A viewer can watch a time shifted version of thesame program, and skip portions of the program that are not of interest.However, when it comes to automated mechanisms of filtering thebroadcast content and storing and indexing the same, there are certainlimitations. Current state-of-the-art systems allow users to specify“programs” as specified in the EPG or to specify a time and channelwhich they would like to record. In some cases, channels air what couldbe termed as un-demarcated content, which one can think of as comprisinglogical segments, but which do not have associated granular metadata.The notion of the name of these logical segments or the precise time ofairing of these segments is not granularized in the stream, for EPG orfor any other applications. Hence, it is not currently possible, fromsuch un-demarcated program content, to filter out only those items thatthe user would be interested in recording and/or storing in an indexedfashion. Therefore there is a need in the art for a solution addressingthe above-mentioned shortcomings and enabling several other enhanceduser experiences.

SUMMARY

A method for creating information in media content is disclosed. Themedia content may be defined by a contiguous stream. The contiguousstream may have a plurality of logically disparate macro segments. Inone embodiment, one or more macro segments of the contiguous stream areidentified. A standardized segment tag associated with of the one ormore macro segments is created. In one embodiment, each standardizedsegment tag is associated with a data set.

The contiguous stream may be on of an audio-video stream, an audio-onlystream, or a video-only stream. The contiguous stream may be broadcastcontent.

In one embodiment, the standardized segment tag is created in media datawithin picture user data. In one embodiment, the standardized segmenttag is created in media data within Supplemental EnhancementInformation. In one embodiment, the standardized segment tag is createdin media data within a private data stream. In one embodiment, thestandardized segment tag is created in media data in an ID3 audio tag.

Creation of the standardized segment tag in media content may beperformed by a content creator. Creation of the standardized segment tagin media content may also be performed by a multiple system operator(MSO).

A method for extracting segments from media content is disclosed. Themedia content is defined by a contiguous stream. In one embodiment, themedia content may be a recorded program. The contiguous stream may havea plurality of logically disparate macro segments. In one embodiment oneor more macro segments of the contiguous stream are identified based onthe presence of a standardized segment tag associated with each macrosegment. Data is extracted from each identified macro segment based onthe associated standardized segment tag.

In one embodiment, a content object is created. The content object maybe at least the tag and the associated macro segment. Content object(s)may be shared with one or more users. One or more tags and data sets maybe shared with one or more users. The content object may be createdbased on a user preference. The content object may be stored in adatabase. The database may be searched based on the user preference. Thecreation of the content object may be performed by a multiple systemoperator (MSO).

In one embodiment, the content object may already be stored in adatabase. In this embodiment, the database may be searched based on auser preference.

The content object may be a data set associated with each identifiedmacro segment. In one embodiment, using the novel properties of thepresent disclosure, creation of duplicate content objects is prevented.

The contiguous stream may be one of: an audio-video stream, anaudio-only stream, and a video-only stream. The contiguous stream may bebroadcast content.

Each standardized segment tag may be associated with a data set. One ormore tags and data sets may be shared with one or more users.

In one embodiment, the extraction of macro segments from media contentis performed by an end-user device.

In one embodiment, one or more segment tags are shared with one or moreusers.

In one embodiment, the extraction of macro segments is based on userpreference information. In this embodiment, the user preferenceinformation may be used to derive information regarding user interests.A device for creating information in media content is disclosed. Themedia content may be defined by a contiguous stream. The contiguousstream may have a plurality of logically disparate macro segments. Inone embodiment a processor is configured to identify one or more macrosegments of the contiguous stream. The processor is configured to createa standardized segment tag associated with each of the one or more macrosegments. A memory is used to store the one or more macro segments andthe standardized segment tag associated with each of the one or moremacro segments.

A device for extracting segments of media content is disclosed. Themedia content may be defined by a contiguous stream. The contiguousstream may have a plurality of logically disparate macro segments. Inone embodiment, a processor is configured to identify one or more macrosegments of the contiguous stream based on the presence of astandardized segment tag associated with each identified macro segment.The processor is configured to extract data from each identified macrosegment based on the associated standardized segment tag. Also disclosedis a memory for storing the extracted data.

BRIEF DESCRIPTION OF THE DRAWINGS

So that the manner in which the above recited features of the presentinvention are attained and can be understood in detail, a moreparticular description of the invention, briefly summarized above, maybe had by reference to the embodiments thereof which are illustrated inthe appended drawings.

It is to be noted, however, that the appended drawings illustrate onlytypical embodiments of this invention and are therefore not to beconsidered limiting of its scope, for the invention may admit to otherequally effective embodiments.

FIG. 1 illustrates an exemplary system 100 for streaming or broadcastingmedia content according to one embodiment;

FIG. 2 illustrates a method 200 for extracting segments from mediacontent according to one embodiment;

FIG. 3 illustrates a contiguous broadcast 300 of home shopping contentaccording to one embodiment;

FIG. 4 illustrates tagging of individual segments of a continuousbroadcast stream 400 according to one embodiment;

FIG. 5 illustrates a segment description data set 500 according to oneembodiment;

FIG. 6 illustrates organization of home shopping content recordingsaccording to one embodiment;

FIG. 7 illustrates a block diagram of an example device 700 according toone embodiment;

FIG. 8 illustrates a method 800 for creating information in mediacontent according to one embodiment;

FIG. 9 illustrates a media content object 905 according to oneembodiment;

FIG. 10 illustrates a method 1000 for saving a content object in adatabase; and

FIG. 11 illustrates a method 1100 for sharing a content object.

DETAILED DESCRIPTION

The system of this disclosure identifies and stores logically disparatesegments in an audio-video (AV) broadcast, e.g., media content.Broadcast content may be filtered based on user preferences and storedin a classified database allowing the user to browse the stored mediacontent at the user's leisure. Previously stored media content may alsobe filtered at an end-user device based on user preferences to provide acollection of one or more logically disparate segments. This collectionof logically disparate segments and/or tags associated with the segmentsmay be shared with other users. Information related to a given recordingmay be transferred from the end-user's device via a separate networkand/or protocol to a communication device of the user's preference.Automated mechanisms are provided to send feedback information on thebroadcast content to Multiple System Operators (MSOs) and broadcastersfrom the end-user device.

The present disclosure describes contiguous content streams thatcomprise of segments which are disparate in a logical and semanticsense. However, in prior art, there is no stream level demarcation(e.g., by means of defined markers) of such segments. An illustrativeand non-limiting example of a segment or “macro segment” as envisionedin this invention is the audio-video content associated with one productin a home shopping channel. The audio-video content associated with theimmediately next product that follows in the same contiguous stream ofthis channel would form the next segment. The contiguous nature of thestream would, in prior art, provide no notion of demarcation of the twosegments. However, for any human viewer, the two segments aresemantically or logically distinct. This invention allows a contentcreator or MSO operator to predefine such segments and the boundariesbetween such segments. A further illustrative example of such a segmentis the audio-video content associated with one joke or routine in acomedy monologue that includes a plurality of such jokes or routines. Acontiguous audio stream which contains song after song, with nodemarcation between the songs in prior art, also can be considered toexemplify the notion of a segment. Each song (which is logically orsemantically distinct to an end-user) forms a segment in this example.

It should be noted that since the notion of a segment has beenconceptualized by this disclosure based on a logical or semantic entity,such a notion of segment operates at a ‘macro’ level, compared to, say,prior art which may have the wherewithal to operate on more ‘micro’level entities such as every MPEG packet, every GOP, fixed timeincrements, every scene change, or every reference frame.

FIG. 1 illustrates an exemplary system 100 for streaming or broadcastingmedia content. Content provider 105 streams media content via network110 to end-user device 115. Content provider 105 may be a headend, e.g.,of a satellite television system or Multiple System Operator (MSO), or aserver, e.g., a media server or Video on Demand (VOD) server. Network110 may be an internet protocol (IP) based network. Network 110 may alsobe a broadcast network used to broadcast television content wherecontent provider 105 is a cable or satellite television provider. Inaddition network 110 may be a wired, e.g., fiber optic, coaxial, orwireless access network, e.g., 3G, 4G, Worldwide Interoperability forMicrowave Access (WiMAX), High Speed Packet Access (HSPA), HSPA+, LongTerm Evolution (LTE). End user device 115 may be a set top box (STB),personal digital assistant (PDA), digital video recorder (DVR),computer, or mobile device, e.g., a laptop, netbook, tablet, portablemedia player, or wireless phone. In addition, end user device 115 maycommunicate with other end user devices 125 via a separate wired orwireless connection or network 120 via various protocols, e.g.,Bluetooth, Wireless Local Area Network (WLAN) protocols. End user device125 may comprise similar devices to end user device 115 and may alsoreceive information from content provider 105 via network 110. End userdevices 115, 125 may be owned by the same user. In addition, end userdevice 115 and end user device 125 may be owned by different users.

In one embodiment, broadcast network, e.g., network 110 streams mediacontent, e.g., an MPEG2 transport stream containing segmented and taggedaudio and video streams, from content provider 105. In this embodiment,the receiving device, e.g., end user device 115 may be a set top box.

Information is provided in the broadcast content or previously storedcontent, so that logically disparate portions of the content, e.g.,media content, can be extracted from a contiguous program and stored asdiscrete content files, e.g., in a database of end user device 115, 125.

Each segment of a given program corresponds to a tag with a unique dataset associated with that segment. The broadcast content is filteredusing automated methods to extract segments of interest from a givenprogram. In one embodiment, the filtering happens on live broadcastswhere the content can be monitored and logically distinct portions ofthe broadcast that are of interest to a user of end user device 115 canbe recorded and stored in an automated fashion.

In another embodiment, logical segments within a previously recordedstream can be indexed and stored in a database. This indexing andstoring can be accomplished either by content provider 105 or end-userdevice 115. In one embodiment, the user can use the database to “browse”through the indexed and stored content. In one embodiment, when theindexing and storing occurs at content provider 105, MSOs can provide“drops” to users who are interested in a certain assortment of logicalsegments.

A database of recordings is created where objects, e.g., content objectsconstituting the individual component media snippets, e.g., logicallydisparate segments of media content, from different programs along withthe information associated with each snippet is stored in an indexedfashion. As stated previously, the database may either be implemented atcontent provider 105 or end-user device 115. Sorting of objects in thedatabase can be done based on different criteria. Retrieval of databasecontent objects (e.g., media content objects or media snippets) fromstorage can be done based on a plurality of search criterion.

Having an organized database on one's set-top enables interworking withother devices like mobiles or portable media players. With both set-topsand other mobile devices supporting communication interfaces such asblue-tooth, one can transfer media objects and metadata from the set-topto a mobile device. DRM restrictions will have to be considered and therestrictions on individual snippets may have to be derived from that ofthe macro program. Several interesting applications are enabled by thisdisclosure. For example, selected songs may be transferred to portablemedia players easily. Where previously one would have had to manuallyedit long recordings to extract songs, a user can now just select andtransfer. Using a home shopping example, if contact numbers can betransmitted to a mobile phone, the user can then make a call withouthaving to jot down and dial the number. Lastly, product details mayeasily be sent to the user's email address for later reference.

In one embodiment, each segment of media content has a uniquestandardized tag with a corresponding associated data set. As such thereis no duplication of media objects in the database even in cases wherethe same media object/segment occurs in different programs that getrecorded.

The present disclosure enables social networking while watchingbroadcasts like shopping channels or music channels. This socialnetworking aspect may be subject to DRM restrictions.

In one embodiment, friends can share media snippets, e.g., one or morefiltered segments or metadata, e.g., a tag and/or an associated dataset. Sharing of the media snippet may be subject to DRM restrictions.For example, in the home shopping example, a user can ask a friend tohelp choose between one of two choices of products (where the productsare described using a media segment and/or a tag and its associated dataset, e.g., category, price, etc.), thus making the shopping a socialactivity.

Users can also share only the metadata associated with the snippet ofinterest without sharing the content itself. For example, if both user1and user2 have recorded the content, user1 only needs to send theindex/metadata associated with the content and user2 can locate the samecontent in the local recording at user2's end user device since eachsnippet will have a unique tag.

Buddy groups can be automatically formed based on user preferences forfiltering. For example, people who have indicated that they want torecord jazz can automatically be included in a buddy group of jazzlovers.

Users who would like to create a blog can upload certain media objectsor metadata associated with the blog from the database in theirset-tops.

In one embodiment, the database objects comprise individual snippetsfiltered from a contiguous program, e.g., the macro program. Thedatabase objects may have a ratings column along with the otherassociated metadata. The ratings column can be synched to a certainserver that provides rating information on the different products/songs.In one embodiment, the user can share the filtered media content, e.g.,media content object, and/or the specifications associated with it, withfriends. In one embodiment, sharing is subject to Digital RightsManagement (DRM) restrictions.

End-user device 115 may share information with another end-user device125 via separate network or connection 120. In one embodiment, the usermay receive the information associated with the individual components ofthe content object on other devices 125, for example a mobile phone,directly from content provider 105, e.g., via network 110.

In one embodiment, end user devices 115, 125 may automatically providefeedback information on the broadcast program to content provider 105.In one embodiment, feedback information conveyed to the broadcasters,e.g., content provider 105, may be popularity of different segments ofthe same program. User inputs may be used to derive informationregarding user interests. Users may specify how programs are to befiltered. This user preference information may automatically be used toprovide feedback on what specific categories are of interest to theusers.

Ratings of popularity of broadcast events are of interest to viewers,broadcasters, and advertisers. Measurement systems like the Nielsenratings exist to cater to this aspect. It should be noted that suchmeasurement systems require dedicated hardware installation andcooperation from the participants. Information on ratings (similar toNielsen's systems) can be provided with the added advantage of beingquick, and easy to deploy and adopt. Further, feedback is provided at amore granular level where the viewer's preference of different segmentswithin the program is to be measured. This feedback information may bepresented to the viewers as well as the content providers. A viewer caninstantaneously be provided with a real time popularity rating of thecontent being watched by the viewer's social network.

The popularity ratings can easily be obtained by having counters on eachof the shows being monitored/viewed/recorded. This can be used inconjunction with various aspects of a user database that are availableto the operator, like demographic information. The feedback informationprovided by the present disclosure may be provided in real time.Feedback on user preferences of segments of the programs can be useddynamically by content providers to provide more popular categories.Real-time ratings can be used by viewers to “see what's latest” duringongoing broadcast of the programming, e.g., media content.

FIG. 2 illustrates a method 200 for extracting segments from mediacontent. The media content may be a contiguous stream. The contiguousstream may be comprised of a plurality of logically disparate macrosegments. At step 205, each macro segment of the contiguous stream isidentified based on the presence of a standardized tag associated witheach macro segment. At step 210, data is extracted from the macrosegment based on the associated standardized segment tag.

Unlike typical metadata, which is often in the form of free flowingcomments or text, the present disclosure uses standardized tags for eachlogically disparate segment, where the notion of the same standardizedtag is commonly shared by the stream/content creator and the contentconsumer/end device for the same segment. As an extension of thisconcept of standardized tags with respect to music or music videos, thesame song, for instance in different program streams, could use the samestandardized tag. Such standardized tags need not be limited toalphanumeric/text characters alone. In one embodiment, standardizedaudio tags may be used. Standardized tags help in searches andde-duplication of segments stored in content objects generated fromdifferent programs.

The use of standardized tags helps in automated searches, which can beacross multiple programs. In addition, the use of standardized tags canalso help in de-duplication, e.g., preventing the saving of duplicatedata in a database.

In one embodiment, a device 105, 115, 125 filters media content todetermine whether a tag associated with a segment of media contentmatches user preference data. The media content to be filtered may be alive broadcast, a recorded program, or content stored in a database atthe MSO.

In one embodiment, the media content comprises a live broadcast. Userscan specify desired channels and content in which the viewer has aninterest. To enable the user to specify the channel of interest andcontent/product category of choice, an interface is provided for theuser to input preferences. This can be implemented as a set of on-screenoptions. For each content type corresponding to a content specifier inthe metadata field for that content, the application may have separateuser entry fields. During initialization or set-up, the user may enterpreferences to mark the categories and the channels that are ofinterest. End user device 115, e.g., set-top, always checks the userpreference. If at least one category is requested, the set-top tunes tothe selected channel/channels and monitors the stream for the user'spreference and initiates recordings accordingly. The recording isstopped when a new segment is encountered, unless that is also onepreferred by the user. Many set-tops come with multiple tuners and thismonitoring and recording may be achieved in the background even if theuser is watching other programs.

In one embodiment, the media content comprises recorded programs. Mediacontent may be recorded in response to scheduling, either automaticallyor manually by a user. When the user schedules a recording of an entireprogram, this program may be filtered and organized in a database. Thefiltering is based on the user's preferences. The user would then beable to browse and watch those segments that are of interest.

In one embodiment, the media content is content stored in a database atthe MSO. MSOs may create tailored content that can be used for VOD likeservices, just by concatenating specific assortments of the mediasnippets, e.g., segments. For example, a viewer may send a request to anMSO for a specific assortment of classical music videos. The MSOs canretrieve the streams from a database and send it to the user. There canbe differential charges for services of this type.

In one embodiment, a content object, e.g., media content object, iscreated by device 105, 115. The content object comprises at least thetag and the associated segment. The content object may be saved in adatabase at content provider 105 or end user device 115. In oneembodiment, the content object is created by the device 105, 115 whenthe tag matches user preference data. FIG. 9 illustrates a media contentobject 905 according to one embodiment. Media content object includesmedia segment 910, tag 915, and optional associated data set 920.

The present disclosure enhances the user experience for programs thatare essentially a concatenation of assorted logical units that aretelecast as a single program. A home shopping channel and a musicchannel (either audio or a channel featuring music videos) are twoexamples that illustrate how the user experience for programs may beenhanced using the present disclosure.

Methods described in the present disclosure may be used to classifysegments of previously un-demarcated content, e.g., music channels. Manychannels air song after song in their programs. Each song is notdemarcated or classified (for instance, based on genre, artist, label,etc.) for recording (wherever permitted by DRM). Often, users record acomplete program consisting of several songs aired consecutively. Usingmethods of the present disclosure, a facility for splitting, labelingand indexing of individual songs/tracks that are recorded fromcontinuous audio-streams by end users is possible.

Appropriate information at the stream level is incorporated, andsubsequently, such information is used for splitting, labeling andindexing of constituent tracks recorded from the program. Even in caseswhere recording is not permitted, the information about each logicalsegment or macro segment incorporated in the stream by the inventionallows for users to inquire about purchase information of individualsongs of a program which, perhaps, has a mix of songs from severalalbums. The content stored or the metadata associated with the contentcan also be shared with other users by networking the receiving device.Social networking groups can be formed with people who have like-mindedtaste with respect to music. These and other user experiences areenabled by the present disclosure.

Another example of an “un-demarcated” program is home shopping channelcontent. This content is generally aired by some channels in a longcontiguous stream wherein the constituent products or categories are notdemarcated as separate programs or any other granular logical segments.Since scheduling of recordings based on constituent logical segments isnot possible in the prior art, the end-user who cannot watch thelive-program, may be forced to record long streams and later perusethese manually to determine portions of interest. Recording of theentire home shopping channel content, does not lend itself easily tosearch among product categories of his choice, or to get all therequired product specifications in a medium of his choice.

The present disclosure enables a viewer to be able to select thosecategories of products of interest and the receiving device, e.g.,end-user device 115, can record and store snippets, e.g., segments,related to only those products in a database (wherever permitted byDRM). This database can then be browsed at leisure and may be searchedbased on price or other specifications for the products of choice. Theshopping experience can be further enriched by having details like phonenumbers directly streamed to a mobile for the user to make the purchase,rather than having to jot down the number and then make a call. As isexplained in the later, other enhanced user experiences like sharingproduct specifications with friends and taking their opinions, orrequesting special drops from MSOs for specific product category areenabled by the present disclosure.

FIG. 3 illustrates a contiguous broadcast 300 of home shopping contentconsisting of different products. Tags are associated with segments ofmedia content. One of the enhancements provided by this disclosure isthe ability to tag logically disparate snippets, e.g., segments, withinany given program. In the context of a shopping channel, the logicallydisparate segments may be the media content related to a single product.FIG. 3 shows how the single shopping program may contain multipleproducts of different categories that are aired continuously one afterthe other. In this example, a shopping channel comprises a continuousstream of different logical segments. Each logical segment has acorresponding tag (J001, E001, E002, F001, J002, F002 . . . ). TagsJ001, 305 and J002, 325 are segments having the category “jewelry”. TagsE001, 310 and E002, 315 are segments having the category “electronics”.Tags F001, 320 and F002, 330 relate to segments having the category“footwear”.

FIG. 4 illustrates tagging of individual segments of a continuousbroadcast channel. With respect to a home shopping broadcast, eachproduct is typically associated with a product ID, product category,price, contact number for purchase, etc. Traditionally this data isnormally sent as part of the video stream, in a form that can only be“seen” by a user who is actively watching the program (either live orstored). The present disclosure allows this information to be“recognized” by an automated system. FIG. 4 shows how each product iseffectively tagged and described by an associated data-set by taggingindividual segments of the video stream 400. Each logical segment isidentified by a corresponding tag (J001, E001, E002, F001, J002, F002 .. . ). Tags J001, 405 and J002, 425 are segments having the category“jewelry”. Tags E001, 410 and E002, 415 are segments having the category“electronics”. Tags F001, 420 and F002, 430 relate to segments havingthe category “footwear”. Each tag has an associated data, 435A, 435B,435C, 435D set that includes: Category, Product ID, Description,Currency, Price, and Contact Number.

FIG. 5 illustrates a segment description data set. Tagging may be donein different ways. An exemplary method is as follows. Most TV broadcastscurrently stream multimedia content in MPEG2 format. MPEG2 video formatprovides an option to add non-video data in the form of “user data”.User data can be inserted on three levels: the sequence level; the groupof pictures (GOP) level; and the picture data level.

At the picture level, this is referred to as picture user data. PictureUser Data is carried on each frame of the video sequence and may containinformation associated with that frame. This frame level association isuseful to mark out sections of a program, without having to referencethe program from any point outside that section.

The picture user data can thus be one option to transmit user datainformation. The picture user data has a unique start-code, and can befollowed by any number of 8-bit words. The data associated with eachsegment can be organized in a single block referred to as SegmentDescription Data Set or SDDS.

The SDDS set can be standardized for a given content type and one of thefields in the SDDS would have a unique code to represent the contenttype. FIG. 5 shows one way of defining SDDS 500 that can be transmittedfor example in picture user data. In this example the SDDS fields aredefined for a product shown in a home shopping channel. The SegmentDescription Data Set—Start Code (SDDS-SC) has a size of 8 bits. The HomeShopping-Product Information Set (HS-PIS) has a size of 8 bits. TheProduct ID, Product Category, and Currency Code each have a size of 16bits. The Product Description and Contact Number each have a size of 16bytes. The Price Value has a size of 10 bytes. The unique code “HS-PIS”indicates a Home Shopping-Product Information Set. The other fields arerelated to the product to be sold that would be of interest to theviewer.

While the above description specifies how Picture User Data can be usedfor MPEG2 video streams, this is by no means the only manner in whichthis information can be sent along with the media content. For MPEG4 AVCstreams there is an option of sending such data in the bitstream, in theSEI (Supplemental Enhancement Information). For MPEG2 TS streams,private data streams may be used to send information along with mediacontent. The .mp4 container format has an option of having private datastreams in which information can be embedded. The example we describedwith the Picture User Data is only an exemplary implementation of thepresent disclosure.

To conceptualize and embody aspects of the present disclosure, thisdisclosure has provided examples of how appropriate tagging informationcan be incorporated into MPEG2 and MPEG4 streams. One having skill inthe art would understand that the present disclosure would also apply toappropriate descriptors for MPEG7 and MPEG21, and future iterations ofMPEG-related standards.

FIG. 6 illustrates organization of home shopping content recordings.Recordings of snippets, e.g., segments, that are tagged, readily lendthemselves to being stored in a database structure. Considering theexemplary tagging system described in FIG. 5, the different fields inthe SDDS, along with the media snippet will constitute one databaseobject. The SDDS will have a one-to-one mapping with the media snippetand hence duplicate recordings of the same segments can be discarded.Since each program may mix media objects/segments differently, the samemedia object/segment may occur in different programs in differentcontexts, i.e. along with a different set of other media segments. Thepresent disclosure guarantees that there is no duplication even in caseswhere multiple programs containing the same media object are recorded.

The database provides a means to sort and search for media content basedon any of the fields of the SDDS. For example, referring to the homeshopping example, products are organized in different categories thatcan further be sorted based on price, description, etc., all of whichare the different fields of an SDDS of type HS-PIS (HomeShopping-Product Info Set) which will be associated with home-shoppingchannels. Similarly, for example, with respect to music channels, mediacontent objects would have a standard associated SDDS type having fieldslike genre, artist, album, etc., which can be used for classifying thedatabase. A simplified illustration in the home shopping context isshown in FIG. 6. In FIG. 6, media segments may be indexed by productcategory, e.g., Jewelry 605, Electronics 610, Footwear 615. Contentobjects related to jewelry 620 are characterized by tags J001, J002, . .. , Jn along with a media segment corresponding to each tag. Contentobjects related to electronics 625 are characterized by tags E001, E002,. . . , Em along with a media segment corresponding to each tag. Contentobjects related to footwear 630 are characterized by tags F001, F002, .. . , Fi along with a media segment corresponding to each tag.

The processes described above, including but not limited to thosepresented in connection with FIGS. 2-6, may be implemented in general,multi-purpose or single purpose processors. Such a processor willexecute instructions, either at the assembly, compiled or machine-level,to perform that process. Those instructions can be written by one ofordinary skill in the art following the description of presented aboveand stored or transmitted on a computer readable medium, e.g., anon-transitory computer-readable medium. The instructions may also becreated using source code or any other known computer-aided design tool.A computer readable medium may be any medium capable of carrying thoseinstructions and include a CD-ROM, DVD, magnetic or other optical disc,tape, silicon memory (e.g., removable, non-removable, volatile ornon-volatile), packetized or non-packetized wireline or wirelesstransmission signals.

FIG. 7 illustrates a block diagram of an example device 700.Specifically, device 700 can be employed to extract segments of mediacontent. Device 700 may be implemented in content provider 105 or enduser device 115, 125.

Device 700 comprises a processor (CPU) 710, a memory 720, e.g., randomaccess memory (RAM) and/or read only memory (ROM), a data extractionmodule 740, standardized tag creation module 750, and variousinput/output devices 730, (e.g., storage devices, including but notlimited to, a tape drive, a floppy drive, a hard disk drive or a compactdisk drive, a receiver, a transmitter, and other devices commonlyrequired in multimedia, e.g., content delivery, system components,Universal Serial Bus (USB) mass storage, network attached storage,storage device on a network cloud). In one embodiment, data extractionmodule 740 stores extracted data in an indexed database resident inmemory 720. In one embodiment, standardized tag creation module 750stores each segment of a contiguous stream and the standardized segmenttag associated with each segment in memory 720.

It should be understood that data extraction module 740 and standardizedtag creation module 750 can be implemented as one or more physicaldevices that are coupled to the CPU 710 through a communication channel.Alternatively, data extraction module 740 and standardized tag creationmodule 750 can be represented by one or more software applications (oreven a combination of software and hardware, e.g., using applicationspecific integrated circuits (ASIC)), where the software is loaded froma storage medium, (e.g., a magnetic or optical drive or diskette) andoperated by the CPU in the memory 720 of the computer. As such, dataextraction module 740 and standardized tag creation module 750(including associated data structures) of the present invention can bestored on a computer readable medium, e.g., RAM memory, magnetic oroptical drive or diskette and the like.

FIG. 8 illustrates a method 800 for creating information in mediacontent according to one embodiment. The media content may be defined bya contiguous stream. The contiguous stream may have a plurality oflogically disparate macro segments. The contiguous stream may be anaudio-video stream, an audio-only stream, or a video-only stream. Atstep 805, each macro segment of the contiguous stream is identified. Atstep 810, a standardized segment tag associated with each macro segmentis created. In one embodiment, method 800 may be performed bystandardized tag creation module 750.

In one embodiment, the standardized segment tag comprises user data. Theuser data may be inserted at a sequence level of the media content, agroup of pictures (GOP) level of the media content, or a picture datalevel of the media content.

In one embodiment, using MPEG4 AVC streams, the standardized segment tagdata may be sent in the bitstream. In this embodiment, the tag may beinserted in SEI (Supplemental Enhancement Information).

In one embodiment, the standardized segment tag may be included in MPEG2TS streams. In this embodiment, private data streams may be used to sendtag information along with media content.

In one embodiment, the standardized segment tag may be included in audiodata. In this embodiment, the standardized segment tag may be an ID3audio tag. ID3 is a metadata container most often used in conjunctionwith the MP3 audio file format. The ID3 tag allows information such asthe title, artist, album, track number, and other information about thefile to be stored in the file itself.

Content creators may inject information, e.g., standardized taginformation unique to the segment, in a stream before it is broadcast.Content creators are typically responsible for one or more of thefollowing: 1) Capturing media content using capture devices such ascamera and microphones; 2) Encoding media content; 3) Generating andgrooming program streams which could potentially multiplex differentchannels of media content. In many cases content copy right could vestwith content creators.

FIG. 10 illustrates a method 1000 for saving a content object in adatabase. At step 1005, a device, e.g., content provider 105 or end userdevice 115, receives a command, e.g., from data extraction module 740,to save the content object in a database. The command to save thecontent object may be initiated once the content object has beenidentified based on user preferences or after a user decides not toshare the content object(s) or tag(s) with additional users. At step1010, a determination is made as to whether the content object hasalready been saved in the database. If the content object has alreadybeen saved in the database, the present content object is discarded atstep 1015. If the content object has not already been saved in thedatabase, the content object is saved in the database at step 1020.

FIG. 11 illustrates a method 1100 for sharing a content object. At step1105, a determination is made as to whether content object(s) or tag(s)with associated data set(s) are desired to be shared by the user withanother user. Step 1105 may be initiated once the content object(s) hasbeen identified using user preference data. Step 1105 may also beinitiated after a user searches for content objects stored in thedatabase (at step 1110) and the search results are presented to the user(at step 1115). If the user desires to share only tag(s) with associatedset(s) with another user, this is performed at step 1120. If the userdesires to share content object(s) with another user, this is performedat step 1125. If the user does not wish to share content object(s) ortag(s) with associated data set(s), the user may be prompted to save thecontent object(s) if the content object(s) have not already been storedin the database.

Advantages of the present disclosure include, but are not limited to,the following: 1) Standardized tags are used: Automated mechanisms forfiltering content allow for efficient searching/filtering of content; 2)Inter-program search: searching for given content across differentprograms is enabled; and 3) Duplication of content recording is avoided:Different assortments of various segments of a program are oftenre-telecast in different programs. The present disclosure ensures thatonly one object will be recorded (as such, there is no duplication).

While the foregoing is directed to embodiments of the present invention,other and further embodiments of the invention may be devised withoutdeparting from the basic scope thereof, and the scope thereof isdetermined by the claims that follow.

What is claimed is:
 1. A method for creating information in mediacontent, the media content defined by a contiguous stream, thecontiguous stream having a plurality of logically disparate macrosegments, the method comprising: identifying one or more macro segmentsof the contiguous stream; and creating a standardized segment tagassociated with each of the one or more macro segments.
 2. The methodaccording to claim 1, wherein the contiguous stream comprises one of: anaudio-video stream, an audio-only stream, a video-only stream.
 3. Themethod according to claim 1, wherein the contiguous stream comprisesbroadcast content.
 4. The method according to claim 1, wherein eachstandardized segment tag is associated with a data set.
 5. The methodaccording to claim 1, further comprising: creating the standardizedsegment tag in media data within picture user data.
 6. The methodaccording to claim 1, further comprising: creating the standardizedsegment tag in media data within Supplemental Enhancement Information.7. The method according to claim 1, further comprising: creating thestandardized segment tag in media data within a private data stream. 8.The method according to claim 1, further comprising: creating thestandardized segment tag in media data in an ID3 audio tag.
 9. Themethod according to claim 1, wherein the creation of the standardizedsegment tag in media content is performed by a content creator.
 10. Themethod according to claim 1, wherein the creation of standardizedsegment tag in media content is performed by a multiple system operator(MSO).
 11. A method for extracting segments from media content, themedia content defined by a contiguous stream, the contiguous streamhaving a plurality of logically disparate macro segments, the methodcomprising: identifying one or more macro segments of the contiguousstream based on the presence of a standardized segment tag associatedwith each macro segment; and extracting data from each identified macrosegment based on the associated standardized segment tag.
 12. The methodaccording to claim 11, further comprising: creating a content object,the content object comprising at least the tag and the associated macrosegment.
 13. The method according to claim 12, wherein one or morecontent objects are shared with one or more users.
 14. The methodaccording to claim 12, wherein one or more tags and data sets are sharedwith one or more users.
 15. The method according to claim 12, whereinthe content object is created based on a user preference.
 16. The methodaccording to claim 15, wherein the content object is stored in adatabase, and further comprising: searching the database based on theuser preference.
 17. The method according to claim 15, wherein thecreation of the content object is performed by a multiple systemoperator (MSO).
 18. The method according to claim 12, wherein thecontent object is stored in a database.
 19. The method according toclaim 18, further comprising: searching the database based on a userpreference.
 20. The method according to claim 12, wherein the contentobject further comprises a data set associated with each identifiedmacro segment.
 21. The method according to claim 12, wherein creation ofduplicate content objects is prevented.
 22. The method according toclaim 11, wherein the contiguous stream comprises one of: audio-videostream, audio-only stream, video-only stream.
 23. The method accordingto claim 11, wherein the contiguous stream comprises broadcast content.24. The method according to claim 11, wherein each standardized segmenttag is associated with a data set.
 25. The method according to claim 24,wherein one or more tags and data sets are shared with one or moreusers.
 26. The method according to claim 11, wherein the media contentcomprises a recorded program.
 27. The method according to claim 11,wherein the extraction of macro segments from media content is performedby an end-user device.
 28. The method according to claim 11, wherein oneor more segment tags are shared with one or more users.
 29. The methodaccording to claim 11, wherein the extraction of macro segments is basedon user preference information.
 30. The method according to claim 29,wherein the user preference information is used to derive informationregarding user interests.
 31. A device for creating information in mediacontent, the media content defined by a contiguous stream, thecontiguous stream having a plurality of logically disparate macrosegments, the device comprising: a processor configured to identify oneor more macro segments of the contiguous stream; the processorconfigured to create a standardized segment tag associated with each ofthe one or more macro segments; and a memory for storing the one or moremacro segments and the standardized segment tag associated with each ofthe one or more macro segments.
 32. A device for extracting segments ofmedia content, the media content defined by a contiguous stream, thecontiguous stream having a plurality of logically disparate macrosegments, the device comprising: a processor configured to identify oneor more macro segments of the contiguous stream based on the presence ofa standardized segment tag associated with each identified macrosegment; the processor configured to extract data from each identifiedmacro segment based on the associated standardized segment tag; and amemory for storing the extracted data.